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APPARATUS, METHOD AND SYSTEM FOR IMAGE 
PROCESSING WITH A COLOR CORRECTION DEVICE 



This application is based on Japanese Patent 
Application No. 241251/1999 filed on August 27, 1999, the 
contents of which are incorporated herein by reference. 

BACKGROUND OP THE TNVFNTTOM 

1. Field of the Invention 

The present invention relates to an apparatus, a 
method and a system for image processing with a color 
correction device for outputting an image by a printer or a 
display. 

2. Description of the prior art 

In a printer or a copying machine, a calibration 
function is realized for a diagnosis and a correction of an 
operating state, so that quality deterioration of an image due to 
a change of environment or a degradation of components is 
prevented. In a digital print apparatus, a calibration is 
performed for adjusting a degree of an image processing such 
as a density correction. In a color print apparatus, a 
calibration is performed for diagnose a color reproduction state. 
In the calibration, a test image is printed and the print result is 
read by a scanner for comparing the read data with reference 
data. In this case, a user usually sets the print result to the 
scanner. 

Usually, the calibration is set to be executed 
automatically every time when a power is turned on. In 
another example, it is executed when the predetermined number 
of days has passed since the previous execution (see U.S. 
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Patent No. 5,889,929). In still another example, the user can 
select an execution time from a plurality of execution times 
(see U.S. Patent No. 5,950,036). 

Since the calibration requires a lot of time, it is 
desirable to execute the calibration only when it is necessary. 
Especially, when printing a test image, frequent calibrations 
may increase a burden of the user. 
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SUMMARY O F THF INVENTION 
The object of the present invention is to reduce the 
number of times of the automatic execution of the calibration 
and to make full use of the performance of the image output 
apparatus. 

An image processing apparatus according to the 
present invention comprises a converter for converting the 
received image data into image data of a standard color space, 
a decision portion for deciding whether the image data 
converted by the converter are within the reference range of the 
color reproduction in the output device, and a controller for 
controlling the output device to perform a calibration of 
making the color reproduction range of the output device close 
to the reference range when the decision portion has decided 
that the image data are out of the reference range. 

An image processing method according to the present 
invention comprises the steps of receiving the image data, 
converting the received image data into image data of a 
standard color space, deciding whether the image data 
converted in the converting step are within the reference range 
of the color reproduction in the output device, and controlling 
the output device to perform a calibration of making the color 
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reproduction range of the output device close to the reference 
range when the image data have been decided to be out of the 
reference range in the deciding step. 

An image processing system according to the present 
invention comprises a 7 correction portion for performing 7 
correction of the received image data, an output device for 
reproducing the image data corrected by the 7 correction 
portion, a converter for converting the received image data into 
image data of a standard color space, a decision portion for 
deciding whether the image data converted by the converter are 
within the reference range of the color reproduction in the 
output device, and a controller for calibrating the 
characteristics of the 7 correction portion so as to make the 
color reproduction range of the output device close to the 
reference range when the decision portion has decided that the 
image data are out of the reference range, wherein the 7 
correction portion corrects the image data by the calibrated 
characteristics, and the output device reproduces the corrected 
image data. 

BRIEF DESCRIPTION OF THK DRAWINGS 
Fig. 1 is a block diagram showing a general 

configuration of an image output system according to the 

present invention. 

Fig. 2 is a block diagram of a color space conversion 

portion . 

Fig. 3 is a block diagram of a reproduction range 
decision portion. 

Figs. 4A and 4B show a concept of a color 
reproduction range. 
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Fig. 5 is a block diagram of a r correction portion. 

Fig. 6 shows contents of a y table. 

Fig. 7 is a block diagram of an image processing 



portion. 



Fig. 8 shows an example of a warning display. 
Fig. 9 is a flow chart of the calibration operation of 
the color correction device. 

DESCRIPTION OF THF. PRF FRRRFT) F.MRQT)TMF.NTS 

Hereinafter, the present invention will be explained 
more in detail with reference to embodiments and drawings. 

Fig. 1 is a block diagram showing a general 
configuration of an image output system 1 according to the 
present invention. The image output system 1 comprises a 
scanner 10 for reading an original by decomposing it into three 
colors, i.e., a red, a green and a blue, a print engine 20 for 
printing a color image, a color correction device 100 that 
realizes the calibration, and a computer 200 for generating a 
print job. More specifically, the image output system 1 is a 
color printer and an image reader, or a computer system having 
a combination machine thereof. The color correction device 
100 built in the color printer or the image reader. Otherwise, 
as an independent apparatus, it is connected by a cable for use. 

In the color correction device 100, an input interface 
103 is input switching means that send data from the scanner 10 
or the computer 200 as input image data Dl to the rear part. 
An image processing portion 104 processes the input image data 
Dl and converts them into CMYK data D2 that are suitable for 
subtractive color. A r correction portion 105 is a circuit 
that sets a r characteristics for each of the C, M, Y and K 
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colors in accordance with the characteristics of the print engine 
20. The T -corrected CMYK data D3 are sent to the print 
engine 20 as an object to be printed via a selector 106. 

The input image data Dl are also sent to a color space 
5 conversion portion 110 from the input interface 103 so as to 
determine whether the calibration is necessary or not. The 
color space conversion portion 110 converts the input image 
data Dl that are RGB data into image data Dls of a standard 
color space (such as a color space of a CIELAB color system). 
10 A reproduction range decision portion 111 decides whether the 
image data Dls are within a reference range of the color 
reproduction by the print engine 20 or not, i.e., whether a color 
that cannot be reproduced is not included. If the image data 
Dls are data out of the reference range, responding to an input 
15 of a signal SJ indicating it, a CPU 109 requests a display 
portion 112 for a message display that asks whether the 
calibration is necessary or not. The display portion 112 
includes a display with a touch panel, for example, so as to 
display a predetermined message and operation buttons. The 
20 CPU 109 is supplied with a signal SC that indicates operation 
contents from the display portion 112. 

When a user instructs the execution of the calibration, 
a test pattern generation portion 107 outputs predetermined test 
image data DT. The selector 106 sends the test image data DT 
25 to the print engine 20. The user sets a piece of paper on 

which a test image is printed on a table of the scanner 10. The 
read data Dt of the test image are stored in an image memory 
108 via the input interface 103. The CPU 109 reads the read 
data Dt from the image memory 108 and compares them with a 
30 target value of the test image, so as to determine a variation 
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quantity of the color reproduction characteristics. Then, the 
CPU 109 selects a 7 correction table in accordance with the 
determined variation quantity and sets the selected 7 
correction table in the 7 correction portion 105. 

By performing this process of the CMYK data D2 in 
the 7 correction portion 105 after the calibration, the color 
reproduction performance of the print engine 20 can be used 
adequately. The input interface 103 or the image processing 
portion 104 may memorize the input image data Dl or the 
CMYK data D2. Otherwise, the image data may be given again 
from the computer 200. 

Fig. 2 is a block diagram of the color space 
conversion portion that is included in the whole configuration 
shown in Fig. 1 . 

The input image data Dl are converted into the XYZ 
color system data by a first operation circuit 110A, and then 
are converted into L*a*b* color system image data Dls by a 
second operation circuit HOB. These conversions are 
performed by a 3 x 3 matrix operation, for example. Letters 
111^ and n ;j (i, j = 1-3) denote conversion coefficients that are 
unique to the scanner 10. It is also possible to convert the 
RGB data into the L*a*b* data by one operation. 

Fig. 3 is a block diagram of the reproduction range 
decision portion. 

Chromaticness indexes a* and b* of the image data 
Dls that are supplied from the color space conversion portion 
110 are given to sixteen look-up tables (LUT) 3 1 0,-3 1 0 16 in 
parallel. Each of the look-up tables 3 1 0, -3 1 0 16 outputs a 
signal for each pixel. The signal indicates a decision of 
whether the input value that is a combination of the 



chromaticness indexes a* and b* is within the reference range 
or not (e.g., "0" means within the reference range, and "1" 
means out of the reference range). Each of the look-up tables 
310,-310 16 stores a table for the decision about a subspace that 
5 is generated by dividing the L*a*b* color space into sixteen in 
the direction of the L* axis. Therefore, the selector 321 
selects one output that corresponds to the value of the lightness 
index L* from the outputs of the sixteen look-up tables 310,- 
3 1 0 2 6 . The selector 321 is supplied with the lightness index 

10 L* as a select signal that was converted from eight bits into 
four bits by a bit conversion portion 320. 

A counter 322 counts the number of the pixels whose 
colors are out of the reference range in accordance with the 
output of the selector 321. Then, the comparator 323 outputs 

15 a signal SJ that indicates that the input image is out of the 
reference range when the output value of the counter 322 
becomes greater than a predetermined value REF. The 
predetermined value REF is given by the CPU 109. 

Figs. 4A and 4B show a concept of the color 

20 reproduction range. 

Fig. 4A shows a three-dimensional space defined by 
the L* axis, the a* axis and the b* axis, in which the color 
reproduction ranges (the reference range and the real range) RS, 
R are solids having a small circle at the ends in the direction of 

25 the L* axis (substantially spheres in Fig. 4A). Fig. 4B shows 
the color reproduction range in two-dimensional space defined 
by the a* axis and the b* axis, in which the L*a*b* color space 
is divided in accordance with plural levels of the lightness 
index L*. It is supposed that the lightness index L* is divided 

30 into sixteen, and the levels 1, 2, ... 16 are set in order from low 
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lightness. Therefore, the color reproduction range in which 
L* = 1 is a small circle. In Fig. 4B, color reproduction ranges 
in which L* = 1, L* = 5 and L* = 10 are drawn. In this 
example, the real color reproduction range R 10 in which L* = 
5 10 is substantially narrower than the reference range RS. 

Fig. 5 is a block diagram of the 7 correction portion. 
The T correction portion 105 comprises four look-up 
tables 501-504 that correspond to four colors, C, M, Y and K, 
respectively. Each of the look-up tables 501-504 can be 

10 switched in the input and output relations. As explained 

above, the CPU 109 sets the optimal 7 table in accordance 
with the print state of the test image. The table may be 
rewritten, or one of plural tables may be selected for use. 
Fig. 6 shows contents of the 7 table. 

15 In the calibration, if the read vale of the test image is 

smaller than the target value, the current table (e.g., the 
standard table 0) is replaced with the table +n whose 7 
characteristics are steep. If the read vale of the test image is 
larger than the target value, the table -m whose 7 

20 characteristics are not steep. In this example shown in Fig. 6, 
there are three kinds of 7 characteristics including the 
standard and the plus side of the standard and the minus side of 
the standard. However, the optimal one is selected from many 
tables having different gradients in reality. 

25 Fig. 7 is a block diagram of the image processing 

portion. 

The contents of the image processing are not related 
to the present invention directly, so the general configuration 
will be explained. 
30 The input image data Dl are converted from intensity 



data to density data DR, DG and DB for each of the R, G and B 
colors by the LOG conversion portion 401. In a masking 
operation portion 402, density data DR, DG and DB are 
converted into color data of C, M and Y adapted to the scanner 
5 characteristics and the print engine characteristics. Then, a 
UCR/BP portion 403 performs a black print generating process, 
in which the C, M and Y equivalent portions are replaced with 
K data. 

An area decision portion 405 performs an area 

10 decision process such as an edge decision in accordance with 

input image data Dl. An MTF correction portion 404 performs 
a process such as an edge emphasis of the CMYK data in 
accordance with the result of the area decision, so as to output 
CMYK data D2 whose image quality is improved. 

15 Fig. 8 shows an example of a warning display. 

If the input image data Dl are out of the reference 
range, a message Zl indicating the fact is displayed. At the 
same time, a message Z2 asking whether the calibration is 
necessary is displayed along with two buttons Z5, Z6. When 

20 the user pushes the button Z5 (Yes), the calibration starts. 
When the button Z6 (No) is pushed, the warning display is 
aborted, and the input image data Dl are printed under the 
current operation condition. 

Fig. 9 is a flow chart of the calibration operation of 

25 the color correction device. 

If the input image data are out of the reference range 
of the color reproduction, a display indicating the fact to the 
user is performed (#11, #12). Then, when the user instructs 
the execution, the calibration is performed. Namely, the test 

30 image is printed, the print result is read by the scanner so as to 
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obtain the read data, and the contents of the 7 correction are 
changed in accordance with the difference between the print 
result and the target value (#13-#18). 

If the input image data are within the reference range 
5 of the color reproduction, or when the user instructs non- 
execution of the calibration even if the input image data are out 
of the reference range, the calibration is not executed, but the 
CMYK data D3 are outputted in accordance with the input 
image data. 

10 According to the above-mentioned example, the 

calibration is executed not regularly but limitedly when it is 
regarded to be necessary from the input image. Therefore, the 
burden of the user, i.e., placing a piece of paper having a 
printed test pattern on the scanner 10 can be eliminated. 

15 According to the present invention, the number of 

times of automatic execution of the calibration can be reduced, 
and the performance of the image output apparatus can be used 
adequately. 

In addition, the user can stop the calibration in 
20 accordance with the state so that the output of the image does 
not delayed. 

While the presently preferred embodiments of the 
present invention have been shown and described, it will be 
understood that the present invention is not limited thereto, and 
25 that various changes and modifications may be made by those 
skilled in the art without departing from the scope of the 
invention as set forth in the appended claims. 
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What is claimed is: 



1. An image processing apparatus for supplying 
received image data to an output device to reproduce the image 

5 data, the apparatus comprising: 

a converter for converting the received image data 
into image data of a standard color space; 

a decision portion for deciding whether the image 
data converted by the converter are within the reference range 
10 of the color reproduction in the output device; and 

a controller for controlling the output device to 
perform a calibration of making the color reproduction range of 
the output device close to the reference range when the 
decision portion has decided that the image data are out of the 
15 reference range. 

2. The image processing apparatus according to 
claim 1, further comprising a display for displaying a message 
asking whether the calibration is necessary or not when the 
decision portion has decided that the image data are out of the 

20 reference range, wherein the controller controls the output 

device to perform the calibration in accordance with a specific 
instruction operation responding to the message displayed on 
the display. 

3. The image processing apparatus according to 

25 claim 1, wherein the output device performs r correction of 
the input image data, the corrected image data are reproduced, 
and characteristics of the 7 correction of the output device 
are changed in the calibration. 

4. The image processing apparatus according to 

30 claim 1, wherein in the calibration the output device reproduces 
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a predetermined test pattern and the controller calibrates the 
color reproduction range of the output device so that the 
reproduced test pattern becomes a predetermined target value. 

5. The image processing apparatus according to 

5 claim 1, wherein the output device reproduces the image on a 
piece of paper. 

6. The image processing apparatus according to 
claim 5, wherein in the calibration the output device reproduces 
a predetermined test pattern on a piece of paper, and the 

10 controller calibrates the color reproduction range of the output 
device so that the image data obtained when an image reader 
reads the test pattern become a predetermined target value. 

7. An image processing method for reproducing 
image data by an output device, the method comprising the 

1 5 steps of: 

receiving the image data; 

converting the received image data into image data of 
a standard color space; 

deciding whether the image data converted in the 
20 converting step are within the reference range of the color 
reproduction in the output device; and 

controlling the output device to perform a calibration 
of making the color reproduction range of the output device 
close to the reference range when the image data have been 
25 decided to be out of the reference range in the deciding step. 

8. The image processing method according to claim 
7, further comprising the step of displaying a message asking 
whether the calibration is necessary or not when it is decided 
that the image data is out of the reference range in the deciding 

30 step, wherein the controlling step includes the step of 
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controlling the output device to perform the calibration in 
accordance with a specific instruction operation responding to 
the message displayed on the display. 

9. The image processing method according to claim 
7, wherein the output device performs 7 correction of the 
input image data, reproduces the corrected image data, and 
characteristics of the 7 correction of the output device are 
changed in the calibration. 

10. The image processing method according to claim 
7, wherein the controlling step includes the steps of: 

reproducing a predetermined test pattern in the output 
device; and 

calibrating the color reproduction range of the output 
device so that the test pattern reproduced in the reproducing 
step becomes a predetermined target value. 

11. The image processing method according to claim 
7, wherein the output device reproduces the image on a piece of 
paper. 

12. The image processing method according to claim 
11, wherein the controlling step includes the steps of: 

reproducing a predetermined test pattern on a piece of 
paper in the output device; and 

calibrating the color reproduction range of the output 
device so that the image data obtained when an image reader 
reads the test pattern reproduced in the reproducing step 
become a predetermined target value. 

13. An image processing system comprising: 

a 7 correction portion for performing 7 correction 
of the received image data; 

an output device for reproducing the image data 
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corrected by the 7 correction portion; 

a converter for converting the received image data 
into image data of a standard color space; 

a decision portion for deciding whether the image 
5 data converted by the converter are within the reference range 
of the color reproduction in the output device; and 

a controller for calibrating the characteristics of the 
7 correction portion so as to make the color reproduction 
range of the output device close to the reference range when 
10 the decision portion has decided that the image data are out of 
the reference range, wherein the 7 correction portion corrects 
the image data by the calibrated characteristics, and the output 
device reproduces the corrected image data. 

14. The image processing system according to claim 
15 13, further comprising a display for displaying a message 

asking whether the calibration is necessary or not when the 
decision portion has decided that the image data are out of the 
reference range, wherein the controller controls the output 
device to perform the calibration in accordance with a specific 
20 instruction operation responding to the message displayed on 
the display. 

15. The image processing system according to claim 
13, wherein in the calibration the output device reproduces a 
predetermined test pattern, and the controller calibrates the 

25 characteristics of the 7 correction portion so that the 

reproduced test pattern becomes a predetermined target value. 

16. The image processing system according to claim 
13, wherein the output device reproduces the image on a piece 
of paper. 

30 17. The image processing system according to claim 
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16, further including an image reader, wherein in the 
calibration the output device reproduces a predetermined test 
pattern on a piece of paper, and the controller calibrates the 
characteristics of the 7 correction portion so that the image 
data obtained when an image reader reads the test pattern 
become a predetermined target value. 
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ABSTRACT OF THE DISCLOSURE 



An apparatus, a method and a system for image 
processing with a color correction device are provided in which 
5 the number of times of automatic execution of calibration is 
reduced and the performance of an image output apparatus is 
used adequately. The apparatus includes a color space 
conversion portion 110 for converting input image data Dl into 
data Dls of a standard color space and a reproduction range 

10 decision portion 111 for deciding whether the input image data 
Dls that were converted into the standard color space are 
within a reference range of a color reproduction in an image 
output. If it is decided that the input image data are out of the 
reference range, the calibration is performed so that the color 

15 reproduction range is made close to the reference range. 
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